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The broad success of optimally controlling quantum systems with external fields has 
been attributed to the favorable topology of the underlying control landscape, where the 
landscape is the physical observable as a function of the controls. The control land- 
scape can be shown to contain no suboptimal trapping extrema upon satisfaction of 
reasonable physical assumptions, but this topological analysis does not hold when sig- 
nificant constraints are placed on the control resources. This work employs simulations 
to explore the topology and features of the control landscape for pure-state population 
transfer with a constrained class of control fields. The fields are parameterized in terms 
of a set of uniformly spaced spectral frequencies, with the associated phases acting as 
the controls. This restricted family of fields provides a simple illustration for assessing 
the impact of constraints upon seeking optimal control. Optimization results reveal that 
the minimum number of phase controls necessary to assure a high yield in the target 
state has a special dependence on the number of accessible energy levels in the quan- 
tum system, revealed from an analysis of the first- and second-order variation of the 
yield with respect to the controls. When an insufficient number of controls and/or a 
weak control fluence are employed, trapping extrema and saddle points are observed on 
the landscape. When the control resources are sufficiently flexible, solutions producing 
the globally maximal yield are found to form connected 'level sets' of continuously 
variable control fields that preserve the yield. These optimal yield level sets are found 
to shrink to isolated points on the top of the landscape as the control field fluence is de- 
creased, and further reduction of the fluence turns these points into suboptimal trapping 
extrema on the landscape. Although constrained control fields can come in many forms 
beyond the cases explored here, the behavior found in this paper is illustrative of the 
impacts that constraints can introduce. 
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I. INTRODUCTION 



The control of quantum systems with tailored external laser fields is an active area of re- 
search. Optimal control experiments (OCE) employing closed-loop learning control' have 
found success in a wide range of applications^, including high harmonic generation^"^, bond- 
breaking in molecules^ and energy transfer in biomolecules'^ Simulations employing opti- 
mal control theory (OCT) have achieved high yields in large numbers of quantum systems^'^^. 
This wide success is attributed to the inherent attractive topology of the underlying quantum 
control landscape, which is the functional relationship between the targeted objective (e.g., 
transfer to an excited state, breaking a chemical bond) and the control field. Control landscapes 
for finite-dimensional quantum systems possess a trap-free topology'^ with no sub-optimal 
local extrema that can hinder attainment of the optimal objective value, upon satisfaction of the 
Assumptions that: (a) the target quantum system is controllable'^, (b) the map from the space 
of control fields to the associated dynamical propagator is surjective'^ '^, and (c) the controls 
are sufficiently flexible such that the landscape may be freely traversed'"* Although uncon- 
trollable quantum systems that violate Assumption (a) can be found, they form a null set in 
the space of Hamiltonians'^. Unusual exceptions to Assumption (b) can be found that produce 
landscape traps'^ '^"^^, but extensive numerical simulations with a broad variety of systems 
that avoid constraints on the controls show that extremely high yields can be achieved without 
encountering traps on the landscape^^"^^. The latter studies demonstrate the importance of As- 
sumption (c) to operate without constraints on the control field in order to ensure a trap-free 
landscape topology. 

Exploring the consequences of constraining the control field in a systematic fashion has 
only received limited attention in the context of landscape analysis^^, even though constraints 
inevitably arise in both simulations and experiments. In simulations, the control field may be 
freely varied, but numerical implementation will introduce some form of constraints. For exam- 
ple, time is typically discretized into ~ lO^-lC values with the field at these time-points acting 
as independent controls, which reduces the continuous infinite-dimensional applied field over 
time to a finite-dimensional set of controls. False traps, i.e., apparent local extrema caused by 
constraints, have been observed on the landscape if insufficient time-resolution is employed^^. 
Another constraint commonly imposed in simulations is to limit the control field fluence in 
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order to prevent convergence to physically unrealistic strong control fields. However, the im- 
position of a stringent fluence constraint can prevent attainment of very high yields In 
the laboratory, the fluence and bandwidth of ultrafast laser pulses are inevitably limited, and 
the laser bandwidth is often discretized by employing a spatial light modulator (SLM)^^ that 
typically provides ~100 control variables, with each taking on ~100 values. Often, the dimen- 
sionality of the control space is further reduced^ '"'^" in an attempt to accelerate the algorithmic 
search. For some objectives, fewer than ~10 well-chosen independent controls can still achieve 
good yields in the laboratory^- although it may not be evident a priori which set of limited 
controls is satisfactory. 

This work examines the consequences of choosing a constrained parameterization of the 
control field on the topology and features of the control landscape for pure state population 
transfer. We employ a control field £(t) containing a set of spectral frequencies cOrn, 



where A(t) > is a Gaussian amplitude function. The phase 0^ associated each frequency Um 
acts as an independent control, while A{t) and the set of cOm are fixed throughout each optimiza- 
tion. The frequencies are chosen to be in a bandwidth determined by the transition frequencies 
of the field-free Hamiltonian. This choice of the field form was made to permit attainment of 
high control yields even when employing a small number of variables (hereafter referred to as 
"controls"), while also facilitating a systematic reduction in the number of controls to explore 
the impact of significant constraints. The fluence of the control field in Eq. (1) is determined 
solely by A{t), which is fixed throughout each optimization trajectory. This formulation is 
analogous to the situation often employed in the laboratory, where many OCE studies vary the 
spectral phase of the ultrafast laser pulse while fixing the pulse energy^"^°. Laser radiation with 
discrete spectral frequencies and a fixed temporal envelope A{t), as utilized in this work, may 
be produced in the laboratory using a laser frequency-comb''^ and the relative phase associ- 
ated with each frequency component of the radiation can be controlled with an SLM^^'^^. The 
phase controls employed here have been used in conjunction with other types of controls in 
simulations^"^, and additional physically reasonable formulations of constrained control fields 
could be constructed as well. 




(1) 



m 
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The control objective in this work is to maximize the probability Pi^j of population transfer 
from an initial pure state \i) to a target pure state |/) of a closed quantum system undergoing 
unitary evolution. Analysis of the landscape topology for this objective without field con- 
straints and satisfying Assumptions (a) and (b) above shows the existence of critical points, 
i.e., landscape extrema where the derivative 5Pi^f / 5e{t) = 0, Vt, only for no population trans- 
fer Pi^f = and optimal transfer Pi^f = l^^'^'^. Further landscape analysis has demonstrated 
a special dependence of the first- and second-order variation of Pi^f with respect to the con- 
trols on the dimension of the landscape Hilbert space (i.e., the number of accessible energy 
levels of the system). The gradient 5Pi^f/5e{t) may be expressed in terms of 2N — 2 linearly 
independent functions of time^^, and analysis of the Hessian matrix 5"^ Pi^j / 5e{t)5e{t') at the 
optimum Pi^f = 1 shows that the maximum number of eigenfunctions (i.e., with correspond- 
ing non-zero negative eigenvalues) specifying control paths that lead down off the top of the 
landscape is also 2N — 2^'^'^'^'^^, which has been verified numerically These results suggest 
that employing at least 2N — 2 independent controls may be necessary in order to reliably at- 
tain a high yield, which was shown in a so-called kinematic formulation of the Pi^f objective 
(i.e., where the controls are not dependent on the structure of the Hamiltonian)^^. This work 
will consider the importance of using at least 2A^ — 2 controls in the dynamical formulation of 
parameterized control fields outlined above. 

The topology of both global optima and suboptimal 'false traps' (i.e., local extrema aris- 
ing from constraints on the controls) are of interest for designing algorithmic procedures that 
efficiently find optimal values of the controls over constrained landscapes. In order to fully 
assess the topology of the constrained landscape upon the restricted control field formulation, 
this work exclusively employs a local gradient-based search algorithm, which will stop climb- 
ing at a suboptimal value of Pi^j if a trap is encountered. Global search algorithms (e.g., 
genetic algorithms) may step over traps, making them inappropriate for assessing topology. 
Global search algorithms are typically employed in laboratory investigations'*"'', and they may 
continue to be favorable once a full understanding is available for the prevalence of constraint- 
induced trapping at suboptimal objective values. The present work assesses the prevalence 
of false traps on the landscape, which may facilitate the design of local and/or global search 
methods that can best achieve an optimal yield. 

4 



As the landscape gradient is zero at a critical point, assessment of the second-order variation 
of Pi^f with respect to the controls is necessary in order to determine the topology around a 
critical point. Suboptimal traps and saddle points can be distinguished based on an analysis of 
the eigenvalues of the Hessian matrix /5e{t)5e{t') at a critical point. A strictly negative 

semi-definite eigenvalue spectrum indicates a trap, while the presence of both positive and 
negative eigenvalues indicates a saddle point. The presence of traps can hinder or prevent 
convergence to the global optimum Pi^f = 1 with a local search algorithm. It is possible to 
escape from saddle points, although these features are known to slow down convergence^"^'^^. 
Behavior at the top of the landscape is of prime interest, where the presence of at most 2N — 2 
nonzero Hessian eigenvalues produces connected optimal submanifolds, or level sets, when 
more than 2N — 2 suitable controls are employed and Pi^j = 1 is reachable. Level sets at the 
global optimum of control landscapes have been explored using a second-order algorithm that 
moves within the Hessian nuUspace (i.e., directions specified by eigenvectors corresponding to 
null Hessian eigenvalues) in order to identify families of connected control fields that maintain 
Pi^f = 1^^. In this work, we will assess the landscape topology of both optimal and sub- 
optimal critical regions. Where optimal level sets at Pi^f = 1 are identified with constrained 
controls, the second-order procedure for traversing these critical submanifolds on the control 
landscape^"^ will be employed in order to explore their features. 

The remainder of the paper is organized as follows: Section II provides theoretical back- 
ground and presents the numerical methods utilized in the simulations. Section III explores the 
consequences of choosing different numbers of controls upon the probability of encountering 
false traps on the landscape. Section IV examines the topology of sub-optimal critical regions 
on the landscape, while Section V considers the features of optimal landscape regions where 
Pi->.f = 1 even with constraints present. Finally, Section VI presents concluding remarks. 

II. METHODS 

A. Formulation of the Control Objective 

Consider a closed quantum system of eigenstates |1), . . . , |A^) of the field-free Hamil- 
tonian Hq with dynamics specified by the time-dependent Hamiltonian H{t) = Hq — ije{t), 
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where /i is the dipole operator and e{t) is the control field. The time-evolution of the quantum 
state \i>{t)) is given as \^{t)) = U {t, 0) \^{0)), where U (t, 0) is the unitary propagator evolved 
from time t = to time t, and |^(0)) is the state of the quantum system at t = 0. The dynamics 
of U (t, 0) are governed by the time-dependent Schrodinger equation (in dimensionless units of 

h=i) 

t^^^^ = H{t)U{t,0), f/(0,0)=L (2) 

The control objective is to maximize the transition probability Pi^j of population transfer 
from an initial state \i) to a target state |/) of the system at time T, 

P.^/ = |(/|f/(T,0)|z)|^ (3) 

Eq. (3) defines the control landscape for population transfer as a functional of 6{t) through the 
dynamics induced by the Schrodinger equation (2). We assume that the system is controllable, 
that is, any arbitrary unitary matrix U{T, 0) can be generated by a suitably chosen field e{t) 
at a sufficiently long final time T. This condition is equivalent to the requirement that the Lie 
algebra generated from Hq and n forms a complete set of operators'^ and T is long enough to 
avoid hindering the dynamics. Controllability is likely satisfied for an arbitrary A^-state quan- 
tum system, as uncontrollable quantum systems have been shown to constitute a null set in the 
space of Hamiltonians'^. The surjectivity requirement for the map between the control space 
and the associated dynamical propagators (i.e., the Jacobian SU{T, 0)/Se{t) is full-rank) also 
appears to be generally satisfied for nearly all control fields'^'^^'^^ Upon satisfaction of these 
requirements, the landscape may be analytically shown to contain no suboptimal extrema'^'^'^, 
provided that no limitations are placed on the control field. Mild constraints on the control 
field may still allow for reaching a fully maximal yield Pi^f = 1.0^^'^^'^'^. However, significant 
constraints on the control field may introduce apparent suboptimal extrema, or false traps, on 
the control landscape. The encroachment of control field constraints on the nominal trap-free 
landscape is the topic explored in this work. 



B. Construction of the Hamiltonian and Control Field 



Many different structures of the field-free Hamiltonian Hq and dipole matrix /i may be 
employed for optimal control simulations. Several distinct control systems are considered in 

6 



Refs. ' , with the landscape topology and structure found to be qualitatively the same regard- 
less of the Hamiltonian. For simplicity, we consider only one and fi structure here. The free 
Hamiltonian Hq has energy levels like that of a rigid rotor, 

Ho=Y,j{j + l)\j){j\. (4) 

j=0 

In many physical systems, the dipole coupling strength between states decreases as the differ- 
ence between the quantum numbers of the states increases. The dipole fi takes this property 
into account and has the structure 

The control fields e{t) consist of Af + 1 evenly-spaced spectral frequencies {cUm} of equal 
amplitude, where the spectral phases {(pm} of the first M frequencies constitute M independent 
controls for optimization, 

M+l 

e{t) = A{t) cos{umt + 0m). (6) 

m=l 

As the physical meaning of the phase of a frequency component in a spectrum is only defined 
with respect to the phase of a reference spectral component, we choose (f)M+i = to provide 
a reference point (i.e., a carrier phase attached to the envelope A{t)y, the relative spectral 
phase controls {0m} are with respect to this reference. With consideration of the transition 
frequencies in Eq. (4), the M+l field frequencies are Um = m, m = 1,2,3, ... M + 1 
and T = 30. A fixed Gaussian envelope A{t) = ^/F exp[^{t — -|)^] is employed to ensure 
smooth switching on and off of the control field. The integrated field fluence is F, where the 
simulations employ values of F ranging from 0.069 to 10. By construction, the fluence remains 
fixed throughout an optimization search over the phases {0m} because A{t) is not allowed to 
vary. In order to ensure a sufficiently fine time-resolution such that no false traps arise on the 
landscape due to the additional constraint of time-discretization^'', we utilized 1024 time-points 
for M < 6, 2048 time-points for 6 < M < 12, and 4096 time-points for M > 13. 
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C. Optimization procedure for climbing the landscape 



This work employs a gradient search procedure to determine the change in the controls {0m} 
at each algorithmic step because it is sensitive to the landscape topology, meaning that the algo- 
rithm will halt upon reaching a suboptimal trap on the control landscape. For implementation 
of the gradient search, the controls {(pm} may be written as a vector $ = 02, • • • 0a/]- We 
define a variable s specifying the progress of the optimal search from an initial random vector 
$(s = 0) to a vector specifying a critical point $* = $(s = S"). S* is the value of s correspond- 
ing to a landscape point that satisfies the critical point condition ^^7^ — 0, where denotes 
the zero vector. The landscape value Pj^/(s) = Pi^f[^{s)] depends upon s through the de- 
pendence of on s. Thus, a differential change in the landscape value dPi^f associated 
with a differential change ds is given by dPi-^f = j ds and the chain rule, 

dP^ ^ dP^d^s)_ 
ds ^$(5) ds ' ^ ^ 

As the objective is to maximize Pt^f, we have the demand that > 0, which specifies that 

$(s) must satisfy the differential equation 

The analytical expression for the gradient on the right-hand side of Eq. (8) will be derived 
below in Section HE. The present search algorithm, incorporated into MATLAB (routine 
ode 4 5)^^, solves Eq. (8) using a fourth order Runge-Kutta integrator with a variable step 
size 7 to determine $ at the next iteration. The search process is terminated when either (a) the 
Pj_>/ value reaches the desired convergence criterion (Pj^j> 0.999 in Sections III and IV, and 
Pi~ff> 0.999999 in Section V) or (b) the P^^/ value between consecutive iterations increases 
by less than 10~^. The latter situation (b) indicates that a suboptimal critical point has been 
reached. 

D. Procedure for exploring optimal level sets 

Analytical and numerical evidence '"^'^"^'^^ shows that the critical value Pi^f = 1 lies on a 
submanifold locally corresponding to the eigenvectors of the Hessian matrix with associated 
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null eigenvalues. If the number of controls M satisfies M > 2N — 2 and they are sufficient 
to achieve P-i^f = 1, then it is expected that the Hessian will contain at least M — 2N + 2 
null eigenvalues and corresponding eigenvectors. The resulting optimal level set of connected 
controls may be explored by continuously varying the controls such that the optimal condition 
Pi^f = 1 is maintained^"^. This movement on the level set requires satisfaction of the second 
order optimality condition 

(PPi^f Sr^sr^ d(j)r„is) ^ , , , ■.■.d(j)rr,'(s 



ds^ l^l^^^nMs),Ms))^^ = 0. (9) 

m m' 

The Hessian matrix 'H{(j)m,(f)m') = ^34,^ corresponds to the second-order variation of 
Pi^f with respect to the control phases 0^ and 0^. An analytical expression for the Hessian 
will be derived in Section HE. To ensure that Eq. (9) holds, one may only move the controls 
{0m (s)} in the direction of the eigenvector(s) of the Hessian with associated null eigenvalues. 

This work will consider the illustrative case at Pi^j = 1 with M = 2N — 1 in Section VB. 
The choice of M = 2N — 1 places the number of controls just above the threshold of 2N — 2, 
considered as the generally minimum number needed to reach = P^'^^. Although more 
than one null Hessian eigenvalue can exist when M = 2N — 1^^, all of the optimal level sets 
found in this work were one-dimensional when M = 2N — 1. The impact of operating with 
other values of M on the landscape topology will be assessed in Section III. In the case of 
M = 2N — 1, the appropriate direction of movement on the level set at Pi^j = 1 to satisfy Eq. 
(9) is 

(9$ 

^ = ±Qo{s) (10) 

where Qo is the Hessian eigenvector corresponding to the zero eigenvalue. The level set may be 
mapped out by taking small steps in s along the direction of ±Qo(s), followed by a recalcula- 
tion of the Hessian and an updated null eigenvector as s evolves. Since numerical inaccuracies 
inevitably result in some variation of Pi^f with increasing s, the optimal value Pi-^f ^ 1 is pre- 
served by alternating level set exploration steps (i.e., Eq. (10)) with gradient climbs via Eq. (8) 
when the Pi^f value falls outside a specified range. In the simulations, when an optimal level 
set at Pi^f = 0.999999 is being explored and the -Pj^/ value drops below Pi^j = 0.99999, 
a gradient climb is employed to regain the value Pi^j = 0.999999, and the level set explo- 
ration is continued from this new point. This automatic correction procedure was found to be 



adequate to ensure faithful exploration of optimal level sets. 

As explained above, controlling the quantum dynamics to climb the landscape and traverse 
an optimal level set calls for solving Eqs. (8) and (10), respectively. The right-hand side of 
these differential equations are highly non-linear in the controls {(prn] through the time evolu- 
tion operator U (t, 0) (c.f.. Section HE). The treatment of the landscape exploration dynamical 
equations (8) and (10) can be considered in analogy to the behavior of non-linear dynamical 
systems^^'"^". In this regard, the optimal level sets are functions of periodic controls, i.e., the 
control values (pm and (pm ± 27™^ for any integer rim produce identical control fields e{t) 
through Eq. (6). Thus, it is possible that the level sets may form periodic trajectories over s in 
the control space Such periodic level sets are analogous to periodic orbits in nonlinear 

dynamical systems^^'^°. However, the optimal level sets do not necessarily have to be peri- 
odic. In this work, we will show that both periodic level sets and aperiodic 'wandering' level 
sets are present on the constrained top of the landscape. The distinct nature of periodic orbits 
and 'wandering sets' with no periodic structure is well-documented in the non-linear dynamics 
literature^^''*°. 

The 'size' of a periodic level set can be measured by the total path length £ traversed by 
{(prn] in s over one period, which may be computed by the integral 



on the closed trajectory defined from s = to s = s*. At the point s*, each of the (pm is shifted 
by an integer Um multiple of In from its value at s = 0. This shift may be zero, with the 
phases {(pm} at s* returning to their initial values. Alternatively, one or more of the (pm may 
grow or decrease in magnitude by 27rnm over a period and still return to a physically equivalent 
point in control space, i.e., producing an identical control field e{t) through Eq. (6) while 
maintaining Pj_^j ^ 1.0. In Eq. (1 1), the derivative /(is between the steps and Sj+i is 

approximated as d4>„i{s) / ds = {(pm{si+i) — (pm{si)) / {st+i — Si). The path length C provides a 
quantitative metric of the extent of periodic level sets in the control space and will be calculated 
for the optimal level sets in Section VB. For 'wandering' level sets that do not have a periodic 
structure, the path length would continue to grow as s increases. This circumstance can include 
cases where individual phases 0^ pass through <pm. ± 27™^, but at distinct values of s for each 




(11) 
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phase m. The numerical evidence for the existence of both types of optimal level sets will be 
assessed in Section VB. 



E. Derivation of the Gradient and Hessian of Pi^f with respect to the controls 

A practical expression for the first-order variation of -Pi->/ with respect to the controls on 
the right-hand side of Eq. (8) is needed to implement the gradient search procedure in Section 
lie. The procedure for exploring optimal level sets in Section IID requires an expression for 
the Hessian matrix, or the second-order variation of with respect to the controls, 
The analysis below derives these expressions. 

The variation of Pi^j due to functional changes in the Hamiltonian SH{t) is obtained by 
considering the resultant responses 5U {t, 0): 

d 

i—6U{t,0)=H{t)6U{t,0) + 6H{t)U{t,0), 6U{0,0) = (12) 
6P,^j = {t\6WiT,0)\f){f\UiT,0)\t) + {t\U^iT,0)\f){f\6UiT,0)\t). (13) 

Eq. (12) can be integrated^^ to give 

dU{t,0) = -i f U{t,t')6H{t')U{t',0)dt', (14) 
Jo 

and substitution of Eq. (14) into Eq. (13) gives 

SP.^f = -2Im r{i\U^{T,0)\f){f\U{T,0)U\t,0)SH{t)U{t,0)\i)dt. (15) 
Jo 

Within the dipole formulation, 5H(t) = —iji5e{t), the functional derivative SPi^j /5e{t) be- 
comes 

A p. f 

= -2Im [(z|f/(T,0)t|/)(/|f/(r,0)f/t(t,0)/i?7(t,0)|2)] . (16) 

From Eq. (16), the first derivative of Pi^j with respect to the controls {(pm} may be obtained 
by the chain rule using the expression for the control field in Eq. (6), 

= r T7?f = 2 Mumt + (17) 

0<pm. Jo Oe[t) d(pm Jo 

where \q) = W{T,0)\f){f\U{T,0)\z) and \k) = f/t(t, 0)/it/(t, 0)^). 
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The Hessian matrix 7/(0^, 4>m') = ^34,^ , obtained from differentiation of Eq. (17) with 
respect to the control 0^/ : 



— ^ =21m 



■'m'-^ym' Jo 



(,|«,C(,0)|.) + (,|t,t(,o),^?^|.) 



A{t) sin(a;^t + 0^) 
+ 5{m,m'){q\k)A{t)cos{uj^t + (t)^) ]dt, (18) 



where 5{m,m') denotes the Kronecker delta function. The derivatives dU{t,0) /dcpm' and 
dU (T, 0)/d(f)'j^ are computed with Eq. (14) for SH = —uSe^t) along with Eq. (16) in a fashion 
analogous to the procedure in Eq. (17). Using the shorthand notation /i(t) = W{t, 0)fiU (t, 0), 
Eq. (18) simplifies to 

n{(Pm,M = 2Rc [ dt\-{i\ [ dt'fx{t')A{t')sm{cUm't' + MU\T,0)\f){f\U{T,0)\k) 
Jo L Jo 

+ {q\ [ dt'fx{t')A{t')sm{um't' + (l)m')\k) 

A{t) Sm{Umt + 0m) 



{q\fi{t) / dt'fi{t')A{t')sm{u^d' + 



+ 21m /" dt5{m,m'){q\k)A{t)cos{uJmt + (pm)- (19) 
Jo 

The Hessian is the M x M dimensional matrix whose elements are given by Eq. (19), which 
is valid anywhere on the landscape. Of particular importance are the Hessian eigenvalues and 
eigenvectors at the critical points on the landscape, as these are needed for determining the 
local topology and for exploration of optimal level sets of controls producing Pi^f ^ 1.0, as 
described in Section 11 D. The Hessian eigenvalue spectrum at suboptimal critical points on the 
landscape is also important because it can be used to classify these landscape points as traps or 
saddles. 



III. ASSESSING THE PREVALENCE AND LOCATION OF TRAPS ON 
CONSTRAINED CONTROL LANDSCAPES 

Any evaluation of the effects of the number of independent controls on the landscape topol- 
ogy must address the nature of the controls being employed. The spectral phase controls {0m} 
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utilized in this work may produce distinct landscapes with different choices of spectral frequen- 
cies; for example, a poor choice would have all of the frequencies {cUm} far away from the Hq 
transition frequencies. Here, we reasonably choose the frequencies to be within the bandwidth 
of the Hq transitions. The equal spacing of the frequencies uj,n = m,m = 1,2,... M+1 results 
in one or more of the frequencies being resonant with the transitions in Hq when m is even, 
(depending on N, c.f., Eq. (4)), and the remaining frequencies (e.g., for odd m) are included in 
order to take advantage of potential Stark shifting of the energy levels upon interaction with the 
control field. All of the frequencies cOrn are shifted to be off-resonant with the Hq transitions in 
one illustrative case as well. Although the numerical simulations consider only the constrained 
field in Eq. (6), the landscape exploration concepts and tools presented here can readily be 
applied to any other choice of constrained field. It is anticipated that many such studies will be 
needed to fully assess the impacts of constrained fields. 

In order to determine the prevalence of traps on the landscape, we employ the local gradient 
algorithm discussed in Section II C because it halts upon reaching a suboptimal critical point. 
The simulations consider the number M of controls that are required to (a) enable at least one 
search out of 100 to achieve Pi^j = 1, or (b) ensure that each search achieves the optimal 
value of Pi^f. Satisfaction of (a) indicates that few enough constraints are present to ensure 
the existence of at least one optimal point on the constrained landscape, and satisfaction of 
(b) suggests that M is sufficiently large to eliminate false traps on the landscape. In between 
these extremes, the goal is to assess both the probability Vc of reaching Pi^j = 1 as a function 
of M, as well as the location of any observed traps on the landscape (i.e., in terms of their 
Pi^f values). Even when traps are present, their effect is less detrimental to optimization when 
they occur at high Pi^j values near the optimum, as closely approaching Pi^f = 1.0 is not 
often necessary in practical applications. As explained in Section II, an analysis of the gradient 
and Hessian of Pi^f with respect to the controls predicts that at least 2N — 2 well-chosen 
controls may be necessary to expect a high probability of convergence This conjecture was 
found to be valid when using kinematic controls (e.g., the matrix elements of the propagator 
U), which are independent of the Hamiltonian^^. Furthermore, since only A^^ well-chosen 
independent controls are required to generate U, it is expected that choosing M = N"^ will 
be sufficient to ensure convergence to an optimal value of Pi^f without encountering traps on 
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the control landscape, provided that no other control constraints (e.g., limited field fluence) are 
present. 

Systems of N states ranging from 3 through 8 using Eqs. (4) and (5) were employed with 
control fields of the form in Eq. (6). Each initial phase 0m(s = 0) was selected from a 
uniform distribution on [0, 2n] and allowed to vary freely as a function of s during optimization. 
Field fluence values ofF = 10, F = 1, and F = 0.1 were employed, where F remains 
fixed throughout each optimization via Eq. (6). The |1) — t- |A^) target transition was chosen 
for optimization because it was found to be the most difficult case to optimize, especially as 

rises, and thus presents the most stringent test of the control landscape topology^^. The 
convergence criterion was Pi^n > 0.999 and the number of controls M in Eq. (6) ranged 
from 2N — 5 through A^^. A total of 100 searches starting at random values of the phases were 
run for each choice of N, M, and F to provide convergence statistics. 

A. Convergence probability 

The prevalence of false traps on the control landscape is assessed by the probability Vc of 
converging to the optimal value Pi^n > 0.999, where a unit convergence probability Vc = 1 
suggests a lack of traps on the landscape. The convergence probability Vc of reaching Pi^n > 
0.999 at selected values of N, M and F is plotted in Figure 1, where the abscissa values M are 
given in terms of (e.g., M = 2N — 2) in order to show the dependence of the convergence 
probability Vc on the number of controls M relative to A^. 

For F = 10 (the circles in Figure 1), the convergence probability Vc at each value of M was 
found to vary little when A^ was changed, so the recorded value of Vc is averaged over all A^ 
from 3 through 8. At least one search was found to reach Pi^n > 0.999 when M > 2N — 4, 
and Vc = I vvas achieved when M > 2A^+ 1. In order to confirm that M = 2A^ + 1 is sufficient 
to ensure convergence without encountering traps, an additional 1000 optimal searches were 
performed for A^ = 3 with M = 7 and A^ = 8 with M = 17. One search became trapped at 
Pi_>3 ~ 0.997 for A^ = 3 and two searches were trapped at Pi^s ~ 0.998 for A^ = 8. Thus, 
traps exist on the landscape when M = 2N + 1 with F = 10, but they are extremely rare and 
occur very close to the landscape top. No traps were found using M = 2N + 2 in an additional 
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1000 searches for = 3, indicating a high likelyhood of a trap-free landscape topology within 
this constrained form of the control field for sufficiently large M. 

Unlike the case of F = 10, the convergence probability Vc at a fixed M does depend on 
for F = 1, as shown by the distinct patterns of convergence exhibited by = 3, 5, and 
8 in Figure 1 (the squares, triangles, and diamonds, respectively). For < 5, a total of 
M > 2N — 4 controls are necessary to attain Pi^n > 0.999 (i.e., at least one search out of 
100 reaching it), and M > 2 A^ — 3 is needed for larger A^. The value of M required to achieve 
Vc = 1 grows with A^, from M > 2N when A^ = 3 and 4 to M > 2A^ + 2 for A^ = 8 (i.e., 
at A^ = 8, Pc = 0.97 with M = 2N + 2). The observed decrease in Vc as A^ rises is due to 
the difficulty of optimizing the |1) — )■ |A^) transition as A^ increases^^, and demonstrates that 
beyond limiting the number of controls, the fluence imposes an additional significant constraint 
on optimization. For F = 0.1 and A^ = 3, a few searches did not converge even upon choosing 
M = N'^, indicating that the fluence is imposing a significant additional constraint since A^^ 
well-chosen controls should be sufficient to generate any propagator U (T, 0). Because of this 
strong additional constraint, searches with A^ > 3 were not performed with F = 0.1. 

For all values of F, M = 2A^ — 2 controls are needed to achieve Vc — 0.5, while using 
fewer controls drastically reduces the convergence probability ioVc < 0.2. It is also apparent 
from Figure 1 that M = 2N — 2 corresponds to the greatest rate of change in the value of Vc, 
in agreement with observations using kinematic controls^^ and corresponding with analysis of 
the gradient and Hessian with respect to Pi^f However, the 'rule' that 2A^ — 2 controls are 
sufficient to produce Vc — 0.5 still requires a good physically relevant choice of controls. In 
many practical situations, the best choice of controls may not be known a priori, and the value 
of A^ may be unknown as well for experimental objectives such as molecular fragmentation^^". 
In these situations, the minimal necessary M and the best choice of controls must be found by 
performing experiments^'^". 

As an illustration of the importance of choosing a good set of M = 2A^ — 2 controls, we 
assess the effects of shifting the M + 1 frequencies of e{t) in Eq. (6) progressively further 
away from the transitions in Hq for the illustrative case of A^ = 3, M = 4, and F = 10. 
Optimization searches were performed for the sets of Af + 1 = 5 frequencies cUm = m + Q 
in Eq. (6) for frequency shift values from = 3 through Q = 19. For comparison, the 
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maximal transition frequency in i^o is -ffo(3, 3) — Ho{l,l) = 6, so all of the field frequencies 
shift to higher values than the Hq transitions when is sufficiently large. 100 searches seeking 
optimal values of the controls {0m} were performed for each set of frequencies defined by fi. 
The convergence probability Vc (blue squares), maximal Pi^s value (red circles), and mean 
value (Pi^s) (green triangles) as a function of Q are plotted in Figure 2, where the value = 5 
is shown as the dashed vertical line, corresponding to the lowest spectral frequency being equal 
to Ho{3, 3) — Ho{l, 1) = 6. When f2 + 1 > 6, the value of Vc significantly decreases. Further 
increasing fl results in a decrease in the mean yield (Pi^^), and when O > 14, no searches 
reached the optimum Pi^s > 0.999. These results show that the '2N — 2 rule' can only be 
expected to hold for a well-chosen form of the control field (here, where the frequencies of the 
control field overlap the transitions in Hq). Thus, the specific nature of limited controls can 
have an impact on the apparent topology of the control landscape. 

B. Location of constraint-induced traps on the landscape 

Further information about the location of false traps (i.e., expressed in terms of Pi^f value) 
on the landscape can be obtained from examining the statistical mean (Pi^f) over the sample 
of 100 searches as a function of N and M. Because a high-quality yield (e.g., Pt^f > 0.999) is 
not necessary for many practical applications, assessing the location of traps on the landscape 
in terms of their Pi^j values is important. If traps exist predominantly at high Pi^j values, 
e.g. Pi^f > 0.95, these may not preclude convergence to an acceptable yield in practice. In 
contrast, the existence of constraint-induced traps at significantly lower yields could pose a 
greater impediment to identifying control fields that produce a suitably high yield. In such 
cases, a stochastic search algorithm may overcome such traps to some degree if a high yield is 
still accessible with the field constraints present. 

The mean value (Pi^n) over 100 searches is plotted as a surface versus and M for 
F = 10 and F = 1 in Figures 3(a) and 3(b), respectively. For both values of F, employing 
M > 2N — 2 typically results in (Pi^m) > 0.99, further indicating that choosing more than 
2N — 2 judicious controls may be sufficient for practical optimization applications. The distinct 
shapes of the resulting surfaces show that choosing F = 10 imposes no further constraint on 
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the optimization beyond the number of controls, but F = 1 is small enough to induce a further 
constraint. For F = 10, (Pi^n) rises with for the same value of M. This behavior is 
intuitive if no other constraints are present, as the relative difference between adjacent values 
of M decreases with rising (e.g., consider M = 2N — 2 and M = 2N — 3, which is M = 14 
versus M = 13 for = 8, but the corresponding values of M = 4 versus M = 3 for = 3), 
so the detrimental effect of reducing M from 2N — 2 to 2A^ — 3 is expected to be smaller for 
A^ = 8 than for A^ = 3. In contrast, at F = 1, increasing A^ results in a decrease of (Pi^at) 
for fixed M in some cases. This distinct behavior arises because the control energy required to 
reach the |1) — t- |A^) transition increases with A^^^, and indicates that the small fluence F = 1 
imposes an additional constraint. 

IV. EXPLORING SUBOPTIMAL CRITICAL REGIONS ON THE LANDSCAPE 

The previous section examined the statistical prevalence and location of traps on constrained 
control landscapes. This section explores the topology and features of suboptimal critical re- 
gions for selected illustrative cases. This information is important for identifying optimization 
procedures, including advanced stochastic algorithms, that may avoid or mitigate their effects 
on the attainable optimization yield and/or the convergence rate. 

A. Constraint-induced saddles 

The results of Section III show that traps arise with inadequately flexible controls, reflected 
in the gradient climbing algorithm getting 'stuck' at a suboptimal value of Pi^f. The appear- 
ance of traps also raises the question of whether saddle regions may arise on constrained control 
landscapes, even though no saddles are present on the unconstrained Pi-^f landscape'^ '"*. Sad- 
dle points on the landscape satisfy dPi^j / 9$ = 0, but have an indefinite Hessian spectrum that 
contains a combination of positive, negative, and null eigenvalues. While a trap has a negative 
semi-definite Hessian, meaning that the Pi^j value cannot increase upon making any small 
perturbation in the controls, there is at least one positive Hessian eigenvalue leading off of a 
saddle point. Thus, a small perturbation in the controls in the direction of the corresponding 
Hessian eigenvector could improve the Pi^f value and escape from a saddle point. However, 
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gradient searches may be attracted by saddles and significantly slow down in the vicinity of a 
saddle point. This effect has been shown to increase the search effort in the cases that encounter 
saddle points for unconstrained optimization of objectives whose landscapes inherently contain 
these features^'*'^^ . 

Some searches reaching Pi^n > 0.999 in Section III display evidence of encountering one 
or more saddles, as measured by the flattening of the trajectory Pi^n^s) versus s at a sub- 
optimal value of Pi^N < 0.999 before ultimately reaching the optimum. One example of a 
search with N = 3, M = A, and F = 1 that encountered a saddle at Pi^s = 0.9 is shown in 
Figure 4. The top panel (a) shows the Pi_>3 value versus s (blue trajectory), which flattens at 
Pi^3 = 0.9 from s ~ 0.1 to s ~ 2. For comparison, a trajectory of Pi_i.3 versus s for a search 
that did not encounter a saddle is shown in green. Examination of the Hessian eigenvalues in 
Figure 4(b) confirms the presence of a saddle point along the blue trajectory of Figure 4(a); in 
this region three eigenvalues are distinctly negative, while the fourth has a very small positive 
value of 0.003 at s = 0.91. For reference, the negative eigenvalues typically fall between the 
values -0.05 and -10 at a local or global maximum when = 3, M = 4, and F = 1. Starting 
at s ^ 2, the search clearly begins to escape the saddle, as shown by the increase in the rate of 
Pi^3 climbing in Figure 4(a), until the search reaches the optimum. A total of 14 searches of 
the 68 that converged to Pi^s > 0.999 for = 3, M = 4, F = 1 were found to encounter 
saddles through analysis of the Pi^s trajectories, the gradient norm | |c?Pi^3/9<l'| |, and the 
Hessian eigenvalues. At each of these saddles, the gradient norm decreases to less than 0.003 
while in the vicinity of the saddle; for reference, the gradient norm at Pi^s ~ 0.999 ranges 
from 0.002 to 0.005 for these searches. At each saddle, only one of the Hessian eigenvalues 
is positive, with values ranging from 0.002 to 0. 1 . In contrast, the largest magnitude negative 
eigenvalue in these regions is less than -10, indicating that the search direction leading off of 
these saddles is very flat. This feature results in the search trajectories significantly slowing 
down, spending between 20% and 60% of the entire search trajectory (as measured by s) in 
the vicinity of the saddle point. This behavior is evident in Figure 4(a), where ~ 40% of 
the search trajectory is spent around the saddle value. Overall, approximately 10% — 30% of 
searches at a given N and F for M between 2N — 2 and 2N that converge to Pi^n > 0.999 
appear to encounter saddles based on examination of their Pi^n trajectories as a function of s, 
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typically at Pi^n ^ 0.9. The presence of saddles in cases where few or no traps exist (i.e., for 
M > 2N — 2) suggests that imposing mild constraints may introduce saddles on the landscape, 
while more severe constraints turn these saddles into trapping extrema. 

B. Constraint-induced traps 

Although encountering a saddle typically increases the effort required to find an optimal 
solution, their presence on the landscape does not prevent successful optimization. In contrast, 
encountering a sub-optimal trap will halt a gradient and possibly other local search algorithms. 
The prevalence of traps on the control landscape was assessed in Section III; here we examine 
their topology through analysis of the Hessian eigenvalues. The vast majority of traps ob- 
served have negative definite Hessians with the smallest negative Hessian eigenvalue typically 
< —0.05 and the largest negative Hessian eigenvalue typically ~ —10, and are thus isolated 
points. All traps observed when employing M < 2N — 2 were found to be isolated points. 
However, in rare cases when M > 2N — 1, one 'zero' Hessian eigenvalue between -0.002 and 
0.005 was observed, which is approximately 0.05% of the magnitude of the largest negative 
Hessian eigenvalue and an order of magnitude smaller than the typical smallest negative Hes- 
sian eigenvalue. For reference, eight of the 14 saddles observed for = 3, M = 4, and F = 1 
had one positive eigenvalue of less than 0.01, with the remaining eigenvalues being less than 
-0.05. Thus, the 'zero' Hessian eigenvalues examined here are of similar magnitude to the lone 
small positive Hessian eigenvalue encountered at some saddle points. 

Representative examples of putative traps with one 'zero' Hessian eigenvalue were further 
examined in order to ascertain the true topology of the landscape in these regions. The second- 
order search method described Section II D was employed to examine these landscape points, 
with the search trajectory in Eq. (10) directed along the Hessian eigenvector with the 'zero' 
eigenvalue. In order to ensure that the search trajectory does not 'fall off the original value 
-PiL>Af' where the star * denotes the trapped Pi^n value, the direction of the 'zero' eigenvalue 
was followed as long as the Pi^n value remained above Pi^^ ^ 0.0001; when the Pi^n value 
fell below this threshold, the gradient climbing method of Section II C was employed until the 
Pi^N value improved by less than 10"^ at consecutive s-steps (i.e., the trapping criterion in 
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Section II C). In some cases, this procedure resulted in a Pi-^n value greater than the initial 
value 

Overall, 17 alleged traps containing one 'zero' eigenvalue were investigated for N rang- 
ing from 3 to 6 and M from 2N — 1 to 2N + 2. Eight of these attained an optimal value 
Pi^N > 0.999 upon moving in the direction of the eigenvector associated with the 'zero' 
eigenvalue. Some cases also required a gradient climb, as discussed above. This behavior indi- 
cates that the putative trap is, in fact, a saddle feature, because it can be escaped upon moving 
in the direction corresponding to the smallest magnitude Hessian eigenvalue. The saddle be- 
havior is presented for five search trajectories of Pi^n versus s beginning with apparent traps 
at values ranging from 0.986 to 0.998 in Figure 5. The cases for = 3 and = 4 

shown in the figure attained Pi^n > 0.999 solely by moving in the direction of the Hessian 
eigenvector corresponding to the 'zero' eigenvalue, while the two cases for = 6 attained 
optimal Pi^N > 0.999 after employing the gradient climb when movement in the direction 
of the 'zero' eigenvalue no longer increased the Pi^n value. The remaining nine cases in- 
vestigated were found to be isolated trapping points, with Pi^n values decreasing from the 
initial value Pi^j^ after few steps along the 'zero' eigenvalue direction, and subsequent gradi- 
ent climbs not reaching the original value Pi_,n- The saddle topology of some apparent traps 
with 'zero' eigenvalues is consistent with the observed saddle topology for some of the = 3, 
M = A, F = 1 searches, with the Hessian direction leading off of the saddle corresponding to a 
very small magnitude eigenvalue. This prevalence of saddles on the landscape, some of which 
were found to halt the gradient search algorithm employed here, indicates that a second-order 
procedure (e.g., conjugate gradient search) may in some cases be superior for searching over 
constrained landscapes, as searches encountering saddles would likely escape from them more 
quickly. 

V. EXPLORING OPTIMAL REGIONS AT THE TOP OF THE LANDSCAPE 

In order to adequately examine the topology at optimal controls on the top of the field- 
constrained landscape, searches from Section III that converged to Pi^j > 0.999 were further 
optimized to Pi^f > 0.999999. This more stringent convergence criterion ensures operation 
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close enough to the top of the landscape such that the predicted topology of optimal regions 
can be examined numerically''*'^'^. In particular, the predicted number of N"^ — 2N + 2 null 
Hessian eigenvalues was confirmed, with each converging to a very small value above —0.002, 
which is ~ 0.02% of the magnitude of the largest negative Hessian eigenvalue. 



A. Hessian eigenvalue spectra for constrained optimal fields 

Optimization to the yield Pi^f > 0.999999 was performed for = 3 with M = 4 through 
1, N = A with M = 6 through 8, and = 5 with M = 8 and 9. For a given choice of 
A^, M, and F, approximately 10% — 40% of the searches from Section III that converged to 
Pi->.f = 0.999 became trapped below Pi-^f = 0.999999 (likely due to numerical discretization 
upon solving the Schrodinger equation acting as a further constraint at high yields^^) and were 
discarded for the following analysis. The mean of each Hessian eigenvalue over the subset 
of the 100 searches that converged to Pi^f > 0.999999 (at least 30 searches in each case) 
is plotted versus its index in Figure 6 for F = 10; the results when F = 1 are similar (not 
shown). The left and right standard deviations from the mean are shown by the error bars for 
the representative case of = 4, M = 8; statistical distributions for the remaining A^ and 
M values were similar. For all A^ = 3 searches, there is a clear break between eigenvalues 4 
and 5, corresponding to eigenvalues labeled by 2A^ — 2 and 2A^ — 1, respectively. A similar 
trend is observed for A^ = 4 between eigenvalues 6 and 7, while for A^ = 5, the corresponding 
jump occurs between eigenvalues 8 and 9. This behavior confirms the predicted features of the 
Hessian spectrum at the top of the landscape'"*. In all of the cases, no 'zero' eigenvalues were 
found when M = 2N — 2, indicating that these optimal solutions are isolated points. This 
circumstance can be interpreted in terms of the underlying optimal submanifold 'shrinking' to 
an isolated point as the number of controls is decreased to the critical value of 2A^ — 2. In these 
cases, increasing M to 2A^ — 1 produces a single 'zero' Hessian eigenvalue corresponding to 
the existence of a one-dimensional level set at the top of the landscape. 
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B. Optimal level sets 



Picking up on the last comment above, we explore one-dimensional optimal level sets for 
illustrative cases with = 3 and M = 2N —1 = 5 using the second-order search method 
described in Section II D. Search trajectories are initiated from an optimal point on the top of 
the landscape identified from the studies in Section V A. A total of five level sets for F = 1, six 
level sets for F = 0.1, and multiple level sets for F < 0.1 were explored. Additional level sets 
likely exist on each landscape beyond those examined here, and similar features are expected to 
arise for those as well. These observed level set features for the simple case of phase controls 
with = 3, M = 5 provide an illustration of behavior that may be encountered upon operating 
with any type of constrained control field beyond the formulation in this work. As discussed in 
Section 11 D, optimal level sets may be aperiodic 'wandering' sets or have a periodic structure 
in control space. 

Three level sets that appeared to be wandering were discovered on the landscape with = 
3, M = 5, and F = 1, listed in Table I. The trajectories of these three level sets never returned 
to the same point in control space, even allowing for 27r shifts in the controls {0m}, which 
strongly suggests that they have an aperiodic structure. The ultimate path lengths of these 
wandering level sets are expected to grow further as s increases. The traversal of the level set 
explored over C = 468 in its three-dimensional projection onto 0i, 02, and 03 can be seen 
as a movie in Figure 7 in the online version of this article, with the full structure of the level 
set shown in the static version of Figure 7. Although numerical searches cannot prove the 
non-existence of any class of level sets, the numerical simulations did not find level sets that 
appear to be wandering for F < 1, which reflects the increased freedom inherent in a high- 
fluence control field. While a full exploration of the effects of high fluence on allowed level 
set structures is beyond the scope of this work, the present results show that a rich variety of 
optimal level set structures exist for sufficiently high control field fluence. 

When the fluence was reduced to F = 0.1, only periodic level sets were found on the 
landscape. Periodic level sets may be classified as 'closed' or 'open', depending on the nature 
of the periodicity. Closed level sets show periodic behavior of each phase, i.e. 0m(s*) = 
0m (0), Vm, while open level sets show growth or decay by 27mm of at least one 0m over a 
period, i.e., 0m (■§*) = 0m(O) ±27™m for some positive integer rim . Importantly, such an integer 
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In shift at s* creates the same field e{0,t) = e{s*,t) through Eq. (6); this behavior is the 
origin of the label 'periodic' for these cases. The difference between closed and open periodic 
level sets can be visualized two ways, as shown in Figure 8 for four distinct level sets on the 
landscape with iV = 3, M = 5, and F = 0.1. Figures 8(a) and (b) show one example of a closed 
and open level set, respectively, where the value of each (pm is plotted versus s over more than 
two periods. The length of a single period is shown for each level set by the dashed vertical lines 
at s* and 2s*. In the closed level set of Figure 8(a), all (pm satisfy 0m(O) = 0m (s*) = </)m (2s*). 
In the open level set of Figure 8(b), the phase 0i (blue) decreases by 0i — 0i — 2n from s = 
to s = s*, and as s is further increased, (pi decreases again by —2n at s = 2s*. The remaining 
phases in this case of Figure 8(b) satisfy 0;(O) = 0/(s*) = (pi{2s*), I ^ 1. The origin of 
the 'closed' and 'open' terminology is evident when examining projections of these level sets 
onto the three-dimensional subspace shown in Figure 8(c). The closed level set ci (from Figure 
8(a)), along with the additional cases C2 and cs, create closed curves in the projected space, 
while the open level set oi from Figure 8(b) (red) does not close on itself due to the phase 
01 decreasing by 2n over a period. However, projecting the level set oi onto any three phase 
controls not including the open control (pi makes the level set artificially appear to be a closed 
curve (not shown). As outlined in Section II D, the 'size' of a periodic one-dimensional level 
set may be measured by its path length C from s = to s = s*. In general, open level sets 
are larger, as seen by comparing the periods in Figures 8(a) and (b) with the increased size of 
the open level set in control space, as additionally shown by Figure 8(c). This behavior is also 
evident in Table I, which presents C for the three open level sets oi, 02, and 03 and three closed 
level sets ci, C2, and C3 observed at F = 0.1. 

Of practical interest are the features of optimal level sets as the control field fluence is further 
reduced below F = 0.1, because fluence resources are inevitably limited in the laboratory. The 
effects of decreasing the fluence on the features of optimal level sets are examined beginning 
from the three periodic open level sets Oi, 02 and 03 identified on the landscape for = 3, 
M = 5, and F = 0.1. To explore level sets at values of F < 0.1, we iteratively decrease 
the fluence by small discrete steps AF. At the ith iterative step with fluence F/, an optimal 
control $*(Fj) is chosen and the fluence is reduced to Fj+i = Fj — AF, . This operation retains 
the phases $*(Fj) in Eq. (6) for the field, but updates the amplitude A{t) to reflect the new 
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fluence F^+i. The latter initial control at Fj+i with this procedure produced a yield that is 
no longer at the top of the landscape, so a gradient climb is then performed beginning at this 
trial control. Upon satisfaction of Pi^j > 0.999999 with the gradient climb finding a new 
optimal field at Fj+i, the second-order search algorithm is employed to map out the nature of 
the corresponding level set. The iterative procedure for reducing F is repeated until an optimal 
value Pi^f > 0.999999 can no longer be reached. This exploration of optimal level sets at 
discrete values of F can only provide snapshot glimpses of the fluence dependence of optimal 
level set features. A thorough investigation would require the development of additional search 
methods that allow the fluence F to continuously vary as a function of s. Nevertheless, the 
features of the optimal level sets observed here are expected to capture basic aspects of the 
fluence dependence. 

A schematic diagram labeling the level sets observed at each value of F is shown in Figure 
9(a), and the associated path lengths of each level set are plotted in Figure 9(b). The solid 
arrows in Figure 9(a) and corresponding solid lines in Figure 9(b) indicate a direct correspon- 
dence between level sets (e.g., oi — t- o[), while dashed arrows and lines indicate suspected 
combining and fracturing of existing level sets. For instance, the three open level sets o[, Og, 
and 03 at F = 0.095 appear to combine to form the closed level set C4 at F = 0.092. Simi- 
larly, the level set c'l at F = 0.088 appears io fracture into two closed level sets C5 and cq at 
F = 0.085. Figure 9(b) shows a wide range of £ values for the open level sets at F > 0.095, 
while the £ values decrease rapidly at F < 0.088. This decrease in £ of each level set is 
magnified in the inset of Figure 9(b), where £ = denotes that the level set has shrunk to an 
isolated point at the top of the landscape. The corresponding value of F indicates the minimal 
'critical' fluence necessary to achieve Pi^3 > 0.999999. 

The presence of distinct critical fluence values from F = 0.069 through F = 0.077 at dif- 
ferent landscape points illustrates how false traps arise on the landscape as constraints become 
more severe. At F = 0.069, the landscape point from level set C12 produces an optimal value 
Fi_s>3 = 0.999999, while the four isolated points resulting from the shrinkage of the level sets 
Cj, cg, cio, and cn produce suboptimal Pi^s values. Gradient climbs with F = 0.069 be- 
ginning from each of the four isolated points were found to become trapped at Pi_>3 values 
ranging from 0.987 through 0.998. Thus, while the optimum can be reached beginning from 
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any of these five points wlien F > 0.077, four of tliese points become landscape traps when F 
is reduced to F = 0.069. From this analysis, the curves in Figure 9(b) continue to lower values 
of Pi_>3 as points (i.e., £ = 0) as the fluence is further lowered for each of them. This behavior 
links up with the observations in Sections IIIB and IV B that constraint-induced isolated trap- 
ping points readily occur on the landscape. These points are drawn down to suboptimal values 
from the landscape top as the fluence is lowered. 

The combining and fracturing of level sets at the top of the landscape considered in Figure 
9 can be visualized by their projections onto three of the phase variables. Figure 10 plots level 
sets at selected values of F < 0.1 by their projections onto (pi, 04, and 05 . The initial open 
level sets oi (red), 02 (green), and 03 (blue) at F = 0.1 are shown in Figure 10(a), where 
the endpoints s = and s = s* are shown as colored circles. The corresponding open level 
sets o[, 02, and 03 at F = 0.095 are shown in Figure 10(b). While o[ has a similar shape to 

01, the level set 03 only follows part of the 03 trajectory, and has a significantly shorter path 
length (c.f.. Figure 9(b)). In contrast, O2 grows in size and can be seen to follow another part 
of 03 in addition to following 02. This behavior is illustrated schematically by the dashed lines 
from 03 to O2 in Figure 9. Figure 10(c) shows that the three open level sets appear to combine 
at F = 0.092 to form level set C4 (cyan), with the corresponding contributing regions of o'^, 

02, and 03 shown as well. Level set C4 changes little as F is reduced to F = 0.088, but the 
resulting level set fractures into C5 and Cg at F = 0.085, as shown in Figure 10(d). The 
subsequent fracturing and shrinkage of C5 and ce at F < 0.085 are shown in Figures 10(e) and 
(f), respectively. 

The optimal level sets explored in this section exhibit many interesting features, both at high 
and low values of the fluence F. Operating at high F = 1 was found to produce both periodic 
and wandering level sets on the top of the control landscape, which suggests that a rich variety 
of optimal level set structures may be present on constrained control landscapes. All observed 
optimal level sets at F = 0.1 were found to be periodic, although the numerical methods in 
this work cannot prove the nonexistence of any class of level sets. The level sets at low fluence 
values of F < 0.1 appear to undergo both combining scad fracturing processes, as shown in 
Figures 9 and 10. This result suggests that at some higher value of F, the wandering level sets 
may undergo similar processes to yield periodic level sets at lower values of F. Although such 
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combining and fracturing processes cannot be visualized directly from just sampling discrete 
F values, it can be conjectured that a singularity occurs at a 'critical' value of F, where either 
one level set splits into two, or multiple level sets combine into one. The same concept of 
a 'critical' fluence applies when an optimal level set shrinks to an isolated point, which was 
observed for all of the optimal level sets explored at sufficiently low fluence. This behavior 
shows that deviations from the anticipated topology of optimal level sets'"^'^^ (i.e., the presence 
of a one-dimensional critical submanifold when M = 2N — 1) can occur when significant 
constraints come into play. While these level set features were found here for a particular class 
of constrained control fields, analogous shrinkage of level sets on control landscapes as fluence 
is reduced has been observed in quantum control experiments for the objective of molecular 
fragmentation"^ ^ Other control resources (e.g., bandwidth) could play a similar role to fluence 
when they become a factor limiting the objective yield. These findings provide an impetus for 
further exploration of optimal and suboptimal level sets, as well as false traps in order to fully 
understand their features when employing different classes of constrained control fields. 



VI. CONCLUSION 

This work explored the topology and local features of constrained quantum control land- 
scapes by choosing a simple parameterization of the control field that provides a small number 
of physically meaningful controls. The numerical results validated analytical predictions about 
the topology and structure of optimal solutions including the importance of employing 
at least 2N — 2 (well-chosen) independent controls in order to achieve a ~ 50% probability 
of reaching the top of the landscape. Suboptimal critical regions on the landscape in the form 
of both isolated trapping points and saddle regions were identified when the constraints were 
significant. An increasing prevalence of isolated trapping points was observed as the number 
of controls was reduced and/or the control field fluence was decreased. Exploration of optimal 
level sets revealed a rich variety of structures producing Pi^f ~ 1 at sufficiently high fluence, 
with the connectedness and size of the level sets decreasing as the fluence was reduced. 

The issue of whether traps exist on quantum control landscapes has recently been the sub- 
ject of much research^^"^''^^. While the presence of traps on otherwise unconstrained control 
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landscapes can be analytically shown for unusual classes of Hamiltonians with constant con- 
trol fields '^'^'^j extensive numerical simulations with reasonable Hamiltonians and care taken 
to avoid control constraints have not found any evidence of landscape traps^^'^"^. This work 
takes the further step of demonstrating that a trap-free landscape topology can exist even when 
a nominally small number of physically reasonable controls is employed. While the land- 
scape topology under any form of constraints has not been assessed analytically, the results 
here strongly suggest that the trap-free topology extends even when mild constraints are im- 
posed on the control resources. Furthermore, the appearance of traps at generally high yields 
(Pj^/> 0.95) under stronger constraints suggests that the trap-free landscape topology only 
gradually disappears as constraints are added. The observed lower bound of 2N — 2 controls 
for relatively easy optimization (i.e., at least ~ 50% of searches reach the landscape top) is also 
consistent with analytical results This '2N — 2 rule' was found to break down, however, 
when the controls were poorly chosen. Overall, our results suggest that the inevitable con- 
straints on control field resources that arise in a laboratory setting may not preclude successful 
optimization. 

The presence of optimal level sets on the top of the control landscape is of practical im- 
portance because the availability of many optimal solutions makes it possible to select amongst 
them for secondary characteristics (e.g., robustness of Pi^f yield to field noise^"*). High control 
field fluence was found to produce rich optimal level set structures (c.f.. Figure 7), however, 
the field fluence cannot be permitted to grow arbitrarily because additional physical processes 
may enter, including possibly of an undesirable nature. Reducing the fluence led to fracturing 
of the level sets and their ultimate shrinkage to isolated points that pulled away from the top of 
the landscape to form false traps as the fluence continued to decrease. The placement of these 
analyses in the context of non-linear dynamical phenomena^^ '*" opens up a new direction for 
assessing control landscape features. Many other measures of the control field can also affect 
the features of optimal and suboptimal solutions. 

This work presented a systematic study of the effects of control constraints on the quantum 
control landscape for pure- state population transfer. The gradual retreat from the ideal trap-free 
topology observed as the control resources become more limited helps to explain the general 
success of many quantum control experiments even when employing constrained controls with 
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limited laser bandwidth and pulse energy^ '". In particular, analogous optimal level set features 
to those found in this paper were observed in molecular fragmentation experiments as the con- 
trol field fluence was reduced"^^ . In addition to the phase controls employed here, other control 
field parameterizations need to be explored in both simulations and experiments with the aim 
of identifying physically reasonable control bases that optimize a broad variety of quantum 
control objectives. 
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TABLE I. Path lengths £ of optimal level sets for iV = 3, M = 5, with fluence F = 1 and F = 0.1. 
The labels for the F = 0.1 level sets are presented in the text, as well as in the Figure(s) indicated. The 
designations 'open' and 'closed' denote the type of periodicity and are explained Sections II D and VB. 
The 'wandering' level set at F = 1 does not appear to have a periodic structure, as explained Section 

VB. 
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FIGURE CAPTIONS 

Figure 1: Convergence probability Vc of optimization searches reaching the threshold 
Pi^N > 0.999 versus the number of controls M. The average value of Vc over N from 3 
through 8 is shown for F = 10 (black circles) because Vc was found to be essentially the 
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same for all from 3 to 8. The Vc value is shown for = 3 (blue squares), = 5 (red 
triangles), and = 8 (green diamonds) at F = 1, with Vc decreasing as A^ rises. Vc is shown 
for F = 0.1, A^ = 3 (magenta x), and not all searches converge even when M = N"^. The 
dashed vertical line denotes M = 2N — 2 controls. 

Figure 2: Convergence statistics for A^ = 3, M = 4, F = 10, with the control field 
frequencies in Eq. (6) shifted to cOm = m + Q, plotted as a function of ^l: probability Vc 
of reaching Pi^s > 0.999 (blue squares), maximal Pi_^3 yield (red circles), and mean yield 
(Pi^s) with error bars denoting left and right standard deviation (green triangles). The values 
of Vc and (-Pi^a) decrease as grows beyond f2 + 1 > Hq{3, 3) — Hq(1, 1) = 6, denoted by 
the vertical dashed line atCl = 5. 

Figure 3: Mean value (Pi^jv) from 100 runs versus the number of controls M and system 
dimension A^ for F = 10 (a) and F = 1 (b). Error bars denoting the left and right standard 
deviations from the mean are included for A^ = 3. In (a), the value (Pi^n) rises both with the 
number of controls M and A^, while in (b), (Pi^n) decreases for some cases of M as A^ grows. 
This behavior is consistent with limited fluence imposing a further constraint in (b) but not in 
(a) with its higher fluence value. 

Figure 4: Search trajectory passing through a saddle point, compared to a trajectory that 
does not encounter a saddle point, for A^ = 3, M = 4, and F = 1. The Pi^^^s) value for 
the search trajectory encountering a saddle (blue) and the trajectory not encountering a saddle 
(green) are shown as a function of s in (a). For the trajectory that encounters a saddle, the four 
Hessian eigenvalues as a function of s are shown in (b). In the saddle region, the eigenvalue 
denoted by the cyan line has a very small positive value of 0.003 at s = 0.91, where the Pi^s 
trajectory is flattest. 

Figure 5: Search trajectories of Pi^n versus index s for apparent constrained landscape 
traps that are in fact saddles. The Pi_i.iv trajectories as a function of s escape from the initial 
putative trapped values at s = 0, and the optimal value Pi^n > 0.999 (shown by 

the dashed horizontal line) is attained. The sudden jumps in Pi^f value on the blue and red 
trajectories occur due to switching from following the Hessian eigenvector corresponding to 
the smallest magnitude eigenvalue to following the gradient. These searches converged to 
Pi^N = 0.999999. On the green and red curves, the lowest Pi^n value was the threshold 
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Pi^jyi — 0.0001 (see the discussion in the text). 

Figure 6: Mean Hessian eigenvalues versus their index at the top of the landscape where 
Pi^f > 0.999999. The index of 2iV - 2 is shown for N = 3,4, and 5 by the respective dashed 
lines. Eigenvalues below their associated 2N — 2 index are distinctly negative, on average 
< —0.1. Eigenvalues above this index are found to be > —0.002 and considered as null; 
these are labeled by the domain with a brace and highlighted in grey on the figure. Error bars 
denoting the left and right standard deviations from the mean are shown for the representative 
example of = 4, M = 8, where the points are shifted on the abscissa for graphical clarity. 
Error bars for the other cases were of similar magnitude. 

Figure 7: (enhanced online) Projection of a wandering level set at the top of the landscape 
for = 3, M = 5, and F = 1 onto 0i, 02, and 03. The green and red dots on the still 
image denote the beginning and end, respectively, of the trajectory explored by the second- 
order search procedure of Section II D. This level set was followed over more than 10^ s-steps, 
with a corresponding path length of £ = 468, and the level set is expected to extend beyond the 
region explored here as s increases further. This level set is called 'wandering' in Table I, as 
the same physical point in search space (i.e., producing an identical e{t)) was not encountered 
twice over the trajectory of M = 5 variables. The traversal of this level set by the red dot is 
animated in the associated movie. 

Figure 8: Phase variables plotted versus s at the top of the landscape for (a) a periodic closed 
level set ci and (b) a periodic open level set oi. These are two disconnected level sets on the 
landscape for = 3, M = 5, and F = 0.1. The dashed vertical lines denote the values s* 
and 2s*, where the first period of each level set is enclosed in < s < s*, and the second 
period is over s* < s < 2s*. In the closed level set, all phases return to their initial values at 
s = s* and s = 2s*. In the open level set case shown here, the phase 0i (blue) decreases by a 
factor of In over one period, while the other phases return to their initial values at s = 0. In 
(c), a three-dimensional projections onto 0i, 03, and 05 of three closed level sets. Here, ci is 
the closed level set in (a), while C2, and c-s are other closed level sets. The open level set oi is 
that in (b). The closed level sets form closed curves in search space, while the open level set 
does not close on itself. However, if the open level set oi is projected onto three of the phase 
controls that do not include the 'open' control 0i, then this level set artificially appears as a 
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closed curve as well. 

Figure 9: Illustration of optimal level set features as a function of control field fluence F 
(see the text for details), (a) Schematic diagram of level sets observed at each value of F. (b) 
Plot of the path length C for each level set as a function of the fluence F. The solid lines denote 
direct correspondence between level sets as F decreases. The dashed lines denote suspected 
combining or fracturing of the level sets. The inset shows the shrinkage of the five level sets 
C7, cg, cio, cii, and C12 at F < 0.08. These five level sets shrink to isolated points with C = 
at distinct values of F ranging from F = 0.069 through F = 0.077. Further reduction of 
F in each case takes these isolated points off the top of the landscape to become suboptimal 
constraint-induced traps. The diagram in (a) is also shown in the animated movie of Figure 10 
in the online version of this article. 

Figure 10: (enhanced online) Projections of optimal level sets for = 3 and M = 5 onto 
the phase controls 0i, 04, and 05 at selected values of the fluence F < 0.1. The level sets are 
animated in the associated movie as F decreases; the six plots (a) through (f) shown in the still 
image highlight some important features: (a) The three open level sets Oi (red; this trajectory 
is distinct from Figure 8(c), as 04 is shown), 02 (green), and 03 (blue) at F = 0.1. (b) The 
corresponding level sets o[, O2, and 03 at F = 0.095. (c) The closed level set C4 at F = 0.092 
(cyan), along with the corresponding regions of the three level sets at F = 0.095 that combine 
to form C4. (d) Level set c'l at F = 0.088 (cyan), and the level sets C5 (magenta) and cq (violet) 
into which it fractures at F = 0.085. (e) Level set C5 and its subsequent fracturing at F < 0.085. 
(f) Level set cg and its subsequent fracturing at F < 0.085. Further reduction of F shrinks all 
of the level sets to isolated points at different values of F as shown by the colored circles in (e) 
and (f), which are highlighted in red in the associated animation. Upon even further reduction 
of F, these isolated points on the landscape 'fall off the landscape top to become isolated 
constraint-induced trapping points. 
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